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ABSTRACT 

A principal limitation of LISP processors in many computa- 
tions is that of inadequate prinssry randojn-access storage. This 
paper explores severs! methods of using a secondary storage 
medium (such es drums, disk files or magnetic tape) to augment 
primary storage capacity and points out some limitations of 
these methods. 
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SECONDARY STORAGE IN LISP 
by Daalel J. Edwards 

A principal limitation of the LISP language, when performing large 
coiepu tat loos, Is aaturatiOQ of prlioary randoos- access storige with active 
Material • both futictiOQS (programs) and lift structures. When saturation 
occurs, the computation is forced to tetminate and one wonders to what 
extent secondary storage isedla (such as drum, disk file or magnetic tape) 
ean be uaed to allow the computation tc continue. In general there is no 
reason to suppose thtt anything short of more primary storage can help, 
except at the cost of a reduction in the computation rate by several orders 
of magnitude -•down to the random access rate of a secondary storage media .^ 
Sovever, in some cases one can make better use of the primary storage medium 
while in other cases use of secondary storage may be worthwhile to allow 
the completion of a computtkLlon at a somewhst higher cose. 

This paper will investigate several methods of using secondary atorage 
to augment the computing capacity of a given LISP Processor. Most of these 
remarks will be directed toward & LISP processor on the IBM 7094. but may 
be generalized to LISP processors on other machines or other list proces- 
sing languages. In particular the primary storage media will be called 
core and the secondary storage will be called tape, disk file or drum 
storage. It should be noted* however, that many of these ideas require 
a gross rewriting of the current 7094 LISP 1.5 processor if they are to 
be successfully Implemented. 
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Lisp Functions 

A. library Tape 

A more efficient use of core storage would be made if the LISP user 
could specify those LISP functions he Intended to use in the current com- 
putation. These functions could then be called from secondary storage 
such as a library tape and the room left In core after the functions are 
loaded could be allocated between list structure storage aad pushdown list. 
The LISP library tape could store compiled functions, functions as S-axpres- 
sions. or both. Each function on the library tape would specify its name 
and the subfunctions it needed and loading could take place in a manner 
similar to the Fortran Monitor BBS library tape. This method still restricts 
the user to one core-full of active material at any one time and this core- 
full must contain all the functions he will use during the computation 
whether currently active or not. 

B. Ring Buffer Function Stora j^e 

This method of storing functions is intended for use with a relatively 
fast drum as secondary storage. It allows the user to have as many active 
functions in compiled form as he wishes. 

First a portion of core is set aside as a program ring buffer. Each 
compiled program is required to keep all of its temporary storage on the 
pushdown list and all function calls and returns must be made through a 
fixed transfer vector which Indicates which functions are In the ring buf- 
fer at any one time. When a function is called which is not in the buffer, 
it is fetched from the drum and read into successively higher locations in 
the buffer. If the top of the buffer is reached the program starts over 
at the bottom. Since all temporary storage of active functions is on the 



A.I. H««o 63 ,3. M«aor«odu» HAC-M-US 

poshdoim list, curr^stly active functlcms oaed never be reed out. lo the 
noret cese ie cyclic eet of funatloas i*ich wlU not fit eiKtlterieously 
into the rtoj buffer), the.fuactioft execution ttae «lll approech the drxm 
rotation Bpeed. However, In typlcel LISP cceqputetlone owch time might el«p«e 
before a function l« celled thet U not In the ring buffer end If ell the 
oeeded functione fit into the ring buffer, the computation vill run et 
full nechlaa «peed» 

ThQ ? Ing buffer iwjthed aight be eotablaed with e coiaptctiog gerbege 
collector illKinsky en£ the ring jgrwf far llet-etructure-itorege beundery 
may b* chingea ecccrding to the seeds of the ccaqmtetlon. 

^- ^iigg-4- j^t!g.^ioa gecX^ ratloR ^ 

EvAK if It ie not desired to .Ifispleasent either of the ebove methods 
for futctloii utoregs, one irey of waking better use of core storage is 
CO .-eriBlnete the requlr^tent that ell LISP functions which nay be used 
in e cooputitlon be in core. An^exeople of this requiretsenc in 70^ LISP 
is th: character handling end acray handllag functions. Many computations 
do n > use either of these features but the spece oust be currently set 
«8l « «s there is no provision for recleloUng this space. This space could 
be mad& aveilable if the uaer could declare those basic functions which 
hf/ does not intend to use and let the garbage collector turn these areas 
iito free storage. This aiethod would involve oeklng a slightly siore coa^ 
yllcated garbfige collector, and Kore study on individual catea would have 
to be nade to detenalac whether the gain In space would offset the Increased 
garbage collection time and complexity. Note that thla idea is iaiplicltly 
contained In both the library tape and program ring buffer i&ethods described 
above. 
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8^fuet»»r «a and S«cond«ry Stor«s« - 

Maay of the probltw of »lo, ..eoiKUry •tar*c« wli* tISP .rUa trom 
th. f«it th.t IBP ft.ely .Uov. u.t, to h«. ,^li,t. i„ e««,a. Oth.r 
lUt »roe«..or. tuch «. thr,«!«4 It.te do not .How cowoo .ublUt. ««J 
thM wold .OM o£ th* .Mond.ry .tor*,, ptoM«,. Ro,^,. it u the - 
«.thor'. oploloa th.t th* cure (no c<««o-«d,lUt.) 1. wore, then th. 
dlee.ee (herd to mefca o«e of seeoadery .tor.je) bec.uee the cwput.eton 
ret. 1. •«* .lower Msen tUe .ad .torege i, .pent copying and recopyU, 
•ubitsts which could be kept In cooBoa. 

A. Pejlat 

One .ethod of u.fa,3 .ecoodery .eor.ge la tISP 1. to divide cor. Into 
e auBber of block, known ,. p,ge, m B«nnek .t«ll.r to the Ferrentl Atle. 
eooputer. Stor.8e r.f.r.«c.. wUbta . ,lv,a p,g. proceed aor».Uy. while 
croe. peg. refer.nc.a u.e . .ubroutlne tc deteneine if the referenced p.ge 
1. m cor.. If not. oat of th. p.ge, in core 1. reed out onto . dru» or 
di.k «nd the required p.ge re.d la. fti, „thod h.. beea programed for 
U.t .cructure, on the KIT PDP-l computer with .n 88.000 word dn«. Thl. 
cioputer I. , 4.096 word. 18 bit. 5 mlcroeecond «chln. with , LISP pro- 
c...or which h„ 800 word, of fr.e .tor.g. In core. Oafortunet.ly. In 
proces.lng U.t .tructure. there i. no good »ethod known for reducing the 
au.d»r of croe. peg. references .nd on . l.rge pr„bl«,. the co«put.tlon 
•peed 1. quickly reduced to the drum rot.tlon .peed. A, ea exe»pl.. one 
•et of function,. rt,lch the 70W reed, to In . few .econd., requlr«J 5 
hour, to reed In with PDP-l LISP. Other coeput.tlon, perfor-ed on both 
PDP-l tISP .nd 7094 USP .how the p.glng method, in f.ct. U-lt. the co,- 
put.tton .peed to the drun rotetlon .peed. 
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S*vicR the paging rcathod nssntiooed ahasf^ Is wattcful of central pro- 
cetsor ttoe, tt has b«en propped to let th« progr^iaaer cr««ce hi» own file 
•y«£ejs 1^ secondftry atorsge an<S then allow hi^ %o print out Use »tructur«s 
vith the tXSP PRIKT program end reed the^i b«ck In with ESAD. This method 
suffers because READ Ani p|!;nn' ere net fast programi! and no oethod Co pre- 
»€rv« coraason Uet B\ih^KpTStsiovk& iu provided. The first objection aay be 
tolerated but xthe «econd citn have cataatrophlc r«6ult». Consider the liat 
ttructure kaovm colloquially jie a BIAH liet ami represented in box notation 
thuB: 






A BLAM lint Is a vsH4 plesie of list structure tn Chat It la not circular » 
but whan copied without pre»er\l?ig ccmktfu ffubempresslons a BLAM Hat of a 
vord» uaes 2 words of fre* storage . The BLAJi Hit ia not as far-f etched 
•a It asy «ee« at first since, under certain circaastances, the pair- list 
in the current LISP 1.5 Interpreter has BLAK liet cheracterlscics. 

Various methods for speeding up the UfAD-PRINT process «uch a.i encoding 
thi? etoffis may be envigioned but failure to preserve ccscaaou subexpreeaiona 
tn the list etntcture ia still * big objection. 

Out icethod of preserving cocmor. ??ibaxpresitlct!S would be to allow the 
user to read out blocki? of list etnicturse tn a coB?psct6d fona auch as sug- 
gested in Mln.sky'E garbage collectcr paper. This method has the additional 
advantfjse of being fairly fast on read-out And very fast on reading in as 
free arorage it kept in « blcck. 



A.l. Memo 63 -6- Memoranduin MAC -K- 12 8 

Any of the Above method* for letting the user put out and call back 
lilt atructuras might allow some cocjputationa to be carried out vhlch 
could not be done otherwise. An example could be the symbolic differ- 
•atlatlon of a series which could be handled term by term with only otie 
term In core at a ttiae. 

C. Automatic Compactlog List Structure Dump 

Another method to utlltEC secondary storage in LISP would be to 
program an autt)matlc list structure dump program In conjenctlon with the 
garbage collector. Initially, the program would be allowed to run until 
all core is filled with active list structure. At this point the garbage 
collector would mark backwards along the most recent part of the pushdown 
list until one-half of available core storage ia marked. Then the list 
structure referred tc by the rest of the pushdown list would be compacted 
and filed in secondary storage. This list structure would be retrieved 
when the pushdown list got back to the point where the filed material was 
needed. 

This method of autorawittic dumrving assumes that atoraic symbols are 
always prese.at and none of the relevant properties are changed during the 
course of the computation. This method also assumes, during the cour3e 
of the computation, list strvictures are found in disjoint pieces which may 
or may not be the case- That is to say that it is possible that during 
a computation most of the active list structures are referred to by the 
most recent items on the pushdown list- It should be noted that items 
referred to on the older part of the pu.<»hdown list cannot b** dumped if they 
have subexpressions in common itesns referred to on the recent part of the 
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P-^ U„. x„ o«.„ CO .«p ... „,,„ ,,_ .,^,., ^^ ^__^ ^^^^ 
«P....lo». ^« ,.^ ,, ,. ,„,,.,..^,,, ,. „^.,^^^^^^ ^^ ^ ^^^^^^^ 

•«rv«<l lAich le quit* hard when utlmi a «.««...•.. 

«a iitiog a c«^«cMng iirbftgc collector. 

^' l^ofc Ahead Method* 

funeuon e.M... could k, ..eX„.. ,0 .. .„o.a..y .cor... X..c.. ch. 

.««P«.r co„„ ch„ perfox. . coc^cdon t»ok .h..a ., c..c ch. co.- 
Pile- prog„. vouH .c.c ,.cc.„s u«.. fro, ..cond.r, .cor.^e vU ..c. 
Channel, b.for. cHe. v.r. .ccu.Uy „...,a. Xn thU v.. «.. cencr.t p„. 
e...or could b. kepc running .t .!.«„; ,„xi ,p,^. 

^* ^<'°clmlon 

A. .bov. «chod. end CO .how. ..c„nd.ry .cor.g. u c.ch.r h.rd co u.. 

for etorlng list etructures during « LISP c«n««^ .4 

'^mg « LISP computet ton. It Is the author*. 

opinion CH.C ch. Cr.d.-o« ,.ccor b.cve.„ prl„r, .nd ..ccnd.r, .cor.g. 

1. .bou. 30 CO 1 m ...or Of „or. prl,.., .cor.ge (1.,.. ^ ^,, .,, ^,,. 

-r, .cor,g. 1. „.rch 30 unlc. of .econd.r, .cor.g.). „„,,,„. ,„ .,,„. 

•tton. where «,re prt«.ry .tor.g. l, „ot «,.il,bie .«o„rf. 

«v«iiHoie, secondary storage may 
be uaed to some advantage In LISP. 



